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A RESEARCH PAPERS FOR COPYING LARGER 



DATABASE FILE IN ANDROID APPLICATION 
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Abstract- this paper on Android deals with copy larger data base from assets/raw folder to 
Android application. 

We can copy a database file or any other file from assets/raw folder to our android 
application by reading byte from file and writing byte to the application, it will work if our 
database size in assets/raw folder is less than 1MB. 

But if database file more than 1Mb in size then you will certainly get the following error 
when you are trying to copy the database. D/asset (909): Data exceeds 
UNCOMPRESS_DATA_MAX (1424000 vs 1048576) 

For that we have to split binary database file into a maximum of 1048576 bytes that is 
Mb and then we have to read those chunks one by one. 

So by this way we can get final full size database in our application. This solution is 
very fast and work perfectly. 
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l. INTRODUCTION 

Android is the world's most popular mobile platform. It is an open source operating 
system. [1] 

Android projects are the projects that eventually get built into an .apk file that you 
install onto a device. They contain things such as application source code and resource files. [6] 

$ -0 MyProject 
& src 

gen [Generated Java Files] 
Android 2.2 
assets 



□ ■fe res 

© ■& drawable-hdpi 
drawable-ldpi 
drawable-mdpi 
© ■& layout 

! & raw 

© & values 
2 AndroidManifest.xml 
S) default. properties 

As per Android documentation assets folder can use it to store raw asset files. Files those 
are save here are compiled into an .apk file as-is, and the original filename is preserved. We can 
navigate this directory in the same way as a typical file system using URIs and read files as a 
stream of bytes using the the AssetManager . [6] ^H^r 

As per android documentation raw folder saves assets file similar to assets folder. But 



only differs in the way that we access them. These files must be referenced from the application 


using a resource identifier in the R class. [6] 



















We can read byte from assets folder or raw folder using InputStream class which is a 
reads the data from a source in a byte-wise manner. m nt f " 

Fetching file from assets folder: InputStream obj = 
getApplicationContext().getAssets().open("myfile"); 

open() method open an asset using ACCESS_STREAMING mode. This provides access to files 
which are placed in to the "assets" directory. 
Fetching file from raw folder: InputStream obj = 

getApplicationContext().getResources().openRawResource(R.raw.myfile); 
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openRawResource() method open a data stream for reading a raw resource. This can only be 
used with resources whose value is the name of an asset files — that is, it can be used to open 
drawable, sound, and raw resources, it will fail on string and color resources. 



2. COPY DATABASE FROM assets/raw Folder 

Step 1: Create a one android project from Eclipse. 

Package name: suppose com.app.main 
Step 2: Copy database file in assets folder. Database file name is mydb and size is 3MB. [2] 

B-Jjp? AndroidProject 
fi-gS src 

□ Jjf com.app.main 
ffl-Jj] main.java 
©' ill sqlengine.java 
gen [Generated Java Files] 
© ■■ft Android 2.2 
assets 
mydb 



$ res 

© ' & drawable-hdpi 
©■ ■& drawable-ldpi 
© ■& drawable-mdpi 
layout 

j & raw 

© ■ & values 
r\P AndroidManifest.xml 
j] default. properties 
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Step 3: Create a new class called sqlengine and derive SQLiteOpenHelper class. A helper class 
to manage database creation and version management. 



package com . app . main; 

import android. content . Context ;[] 

public class sqlengine extends SQL iteOpenHe lper { 

private SQLiteDatabase myDataEase; 

private final Context myCojnLte^t; 

sqlengine sql; 
^ * * 

* Constructor Takes and keeps a reference of the passed context in order to 

* access to the application assets and resources. 

V 

public sqlengine (Context context) { 
super (context, "mydb", null, 1); 
this .myContext = context; 

} 

SOverr ide 

public synchronized void close () { 
if [myDataEase != null) 
myDataEase . close ( ) ; 
super . close ( ) ; 

} 

SOverr ide 

public void onCreate ( SQL iteDat abase db) { 
// TODO Auto-generated method stub 

} 

G Overr ide 

public void onUpgrade (SQLiteDatabase db, int oldVersion, int neuVersion) { 
// TODO Auto-generated method stub 

} 

_} 

Step 4: Create a method in class called createDataBase() which will check whether the particular 
database is exits or not, if it is not exits than it will copy the database from assets/raw folder to 
our application. 
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public void createDataBase ( ) throws IOException { 
boolean dbExist = checkDataBase ( ) ; 
if (dbExist) { 

// do nothing - database already exist 
} else { 

// By calling this method and empty database will be created into 
// the default system path 
this . getReadab leDatabase ( ) ; 
copyDataBase () ; 

} 

} 

So to check existence we have to make checkDataBase() method and to copy database we 
have to create copyDataBase() method in sqlengine class. 

private boolean checkDataBase ( ) { 
SQL iteDatabase checkDB = null; 
try { 

String myPath = "/ data/ data/ coin, app .main/ databases/ " + "mydb"; 
checkDB = SQL iteDat abase . openDatabase (myPath, null, 
SQL iteDat abase. 0PEN_READ0NLY) ; 
} catch (SQLiteExcept ion e) { 

// database does' t exist yet. 

} 

if (checkDB != null) { 
checkDB . close ( ) ; 

} 

return checkDB != null ? true : false; 

} 

private void copyDataBase ( ) { 

// Open your local db as the input stream 
try { 

OutputStream databaseOutputStream = new FileOutputStream ( 

"/ data/ data/ com. app .main/ databases/ " + "mydb"); 
InputStream database InputStr earn; 
toyte[] buffer = new byte [1024]; 
int length; 

y\^y\^y\^y3\^y\^y^ 



database InputStream = myContext . getResources ( ) .getAssetsf) . open ( "mydb") ; 
while ((length = database InputStream. read (buff er) ) > 0) { 
databaseOutputStream. write (buffer) ; 

} 

databaseOutputStream. flush ( ) ; 
databaseOutputStream. close ( ) ; 



catch (Exception e) { 

// T0D0 Auto-generated catch block 
e . pr intStackTrace ( ) ; 
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So now sqlengine class is ready having three extra method - createDataBase() ,checkDataBase(), 
copyDataBase(). 

Step 5: call this class from our activity. 

public class main extends Activity { 
@ Override 

public void onCreate (Bundle savedlnstanceState ) { 
super . onCreate (savedlnstanceState) ; 
setContentView (R. layout .jn-aiji) ; 

sqlengine objSqlEngine = new sqlengine (getApplicat ionContext ()) ; 
try { 

ob jSqlEngine . createDataBase ( ) ; 
} catch (IOException e) { 
e . pr intStackTrace ( ) ; 

> 

ob j SqlEngine . close ( ) ; 

> 

} 

So on call createDataBase() method from activity, it will call checkDataBase() method to check 
whether mydb database is exits or not and if the method returns false then it will call 
copyDataBaseQ method to copy file from assets folder and call read() method to read byte, but it 
will certainly throws the following error when it tries to copy the database. 

I 58 36 Database sqlite returned: error code = 14, msg = cannot open file at source line 25467 

E 58 8 6 Database sql i te3_open_v2 ( 'Vdata/data/com . app . ma in/dat abases/my db " , ^handle, 1, NULL) failed 

D 58 8 6 asset Data exceeds UNCOMPRESS_DATA_MAX (7989248 vs 1048576) 

W 5886 System. err java . io . IOEscept ion 

U 5886 System. err at android . content . res . AssetManager . readAsset ( Nat ive Method) 

W 5886 System. err at android . content . res . AssetManager . access$700 (AssetManager . java : 36 ) 

U 58 8 6 System. err at android . content . res . AssetManagerSAsset InputStream . read ( AssetManager . j ava : 5 7 1 ) 

U 58 8 6 System. err at com . app . main . sqlengine . copyDataBase (sqlengine . java : 9 ) 

W 5886 System. err at com . app . main . sqlengine . createDataBase ( sqlengine . java : 60 ) 

U 58 8 6 System. err at com . app . main . main . onCreate ( main . j ava : 1 7 ) 

W 5886 System. err at android . app . Instrumentation . callActivityOnCreate( Instrumentation . java : 1047 ) 

W 5886 System. err at android . app . Act ivi tyThread . perf ormLaunchAct ivi ty( Act ivi tyThread . java : 2627 ) 

U 58 8 6 System. err at android . app . Act ivi tyThread . handleLaunchAct ivi ty ( Act ivi tyThread . j ava : 2 6 7 9 ) 

W 58 8 6 System. err at android . app . Act ivi tyThread . access$2300 (Act ivi tyThread . java : 125 ) 

U 58 8 6 System. err at android . app . Act ivi tyThreadSH . handleMessage ( Act ivi tyThread . java : 20 3 3 ) 

U 58 8 6 System. err at android . os . Handler . dispatchMessage (Handler . java : 99 ) 

W 5886 System. err at android . os . Looper . loop (Looper . java : 123 ) 

U 58 8 6 System. err at android . app . Act ivi tyThread . main (Act ivi tyThread . java : 4627 ) 

U 58 8 6 System. err at java . lang . ref lect . Method . invokeNat ive (Nat ive Method) 

W 5886 System. err at java . lang . ref lect . Method . invoke (Method . java : 521 ) 

U 58 8 6 System. err at com . android . internal . os . Zygotelnit SMethodAndArgsCal ler . run (Zygotelnit . java : 868 ) 

W 5886 System. err at com . android . internal . os . Zygotelnit . main(ZygoteInit . java : 626 ) 

W 5886 System. err at dalvik . system . NativeStart . main(Native Method) 

I 61 Act ivi tyManager Displayed activity com . app . main/ . main : 3810 ms (total 3810 ms) 

Due to the fact that there is a file size limit (upto 1 MB) on resources in the raw or assets folders. 
Finally it indicates that you cannot copy the file which is >1 MB into your application at 
runtime. 

And on seeing DDMS - > File Explorer->data->data->com.app.main->database we can see 
mydbfile has been created but its size is zero. 
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Name 


Size 


Date Time 


Permissions 


Info | 



□ & com. app. main 
□ & databases 
[S] mydb 
© & lib 



2012-12-07 20:45 drwxr-x--x 

2012-12-07 21:19 drwxrwx-x 

2012-12-07 21:19 -rw-rw — 

2012-11-13 07:05 drwxr-xr-x 



So we can copy a file larger than 1MB from assets folder to android application. 

Step 4: Remove the mydb file from assets folder and copy that file in raw/ folder. Do minor 

change in copyDataBase() function i.e. replace InputStream obj = 

getApplicationContext().getAssets().open("mydb"); with InputStream obj = 

getApplicationContext().getResources().openRawResource(R.raw.mydb); 

Now during runtime on call this method it will similarly throws an runtime error and on 
seeing DDMS - > File Explorer->data->data->com.app.main->database we can see mydbfile has 
been created but its size is zero. 

So we cannot copy the file from assets or raw folder whose size is larger than 1MB. 

So the solution is to split the file in to IMB's file chunks and read those chunks one by 

one. 



3. COPYING LARGER THAN ONE 1MB FILE FROM assets/raw Folder 

Step 1. Split the file: used the Linux split command to split the binary database file into a 

maximum of 1048576 bytes. [3] 
■ The command is: split mydb -b 1048576 db_ 

o Here mydb is the database file which we want to split in to 1MB chunks, 
o 1048576 is the size of the single chunk. 1048576 byte = 1MB 
o And db_ is the output file prefix. 

o So in this example our mydb file's size is 3MB, so command will split the file in to three chunks, 

each of them has 1MB file size and their name would be db_aa, db_ab, db_ac respectively. 
Step 2. Copy these files into raw resource folder. [3] 
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res 



$ ■& drawable-hdpi 
E) -& drawable-ldpi 
© ■& drawable-mdpi 
S -& layout 
□ raw 

■ [S| db_aa 
db_ab 
[P] db_ac 
values 

Step 3. And do minor changes in copyDataBase() method in sqlengine class, as now we have 
the chunks of file we have to read one by one each chunks and write them into application 
database. 

private void copyDataBase ( ) { 

// Open your local db as the input stream 
try { 

OutputStream database Out put St ream = new F i leOutputStream ( 

"/ data/ data/ com. app .main/ databases/ " + "mydb") ; 
InputStream database InputStream; 

byte[] buffer = new byte [1024]; 
int length; 

database InputStream = niyContext . getResources ( ) . openRauResource (R. raw. db_aa) ; 
while ((length = database InputStream. read (buff er) ) > □) { 
databaseOutputStr earn. write (buffer) ; 

} 

database InputStream. close () ; 

database InputStream = inyContext . getResources ( ) . openRawResource (R. raw. db_ab) ; 
while ((length = database InputStream. read (buff er) ) > 0) { 
databaseOutputStr earn. write (buffer) ; 

} 

database InputStream. close () ; 

database InputStream = inyContext . getResources ( ) . openRawResource (R. raw. db_ac) ; 
while ((length = database InputStream. read (buff er) ) > 0) { 
databaseOutputStr earn. write (buffer) ; 

} 

database InputStream. close () ; 
databaseOutputStr earn. flush ( ) ; 
databaseOutputStr earn. close () ; 



} catch (Exception e) { 

// T0D0 Auto-generated catch block 
e . pr intStackTrace ( ) ; 

} 
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So on call copyDataBase() method by createDataBase() method it will read files in to raw folder 
and copy to application database that is in /data/data/com.app.main/databases/ folder. And we 



can get fully copied database. 



Name 



B & conn ,app. main 
□ & databases 
B) mydb 
© & lib 



Size Date 

2012-12-07 
2012-12-07 
3145723 2012-12-07 
2012-11-13 



Time Permissions Info 

20:45 drwxr-x-x 

22:44 drwxrwx-x 

22:44 -rw-rw- — 

07:05 drwxr-xr-x 
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4. CONCLUSION 

The solution works perfectly and it's very fast. Final database size on the emulator is 3,072 KB 
It copies almost instantly. There is no delay when the application first runs. 
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